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Abstract. Cosmic-ray particles with ultra-high energies (above 10^® eV) are studied through 
the properties of extensive air showers which they initiate in the atmosphere. The Pierre Auger 
Observatory detects these showers with unprecedented exposnre and precision and the collected 
data are processed via dedicated software codes. Monte Carlo simulations of extensive air 
showers are very computationally expensive, especially at the highest energies and calculations 
are performed on the GRID for this purpose. The processing of measured and simulated data 
is described, together with a brief list of physics results which have been achieved. 


1. Introduction 

The Pierre Auger Observatory [1] is the largest experiment ever built to measure the extensive 
air showers induced by cosmic rays of energy above 10^^ eV (UHECR). The Observatory (see 
Fig. [U is located on the Argentinian Pampa at an altitude of about 1 400 m a.s.h, near the 
city of Malargiie in the province Mendoza. It predominantly observes the southern sky. On the 
ground, shower detection employs water-Cherenkov detectors (see left panel of Fig. ED- These are 
combined with the telescopic observation (see right panel of Fig. [2]) of atmospheric fluorescence 
light on clear moonless nights. Four fluorescence detector sites surround the surface detector, 
which has an enclosed area of 3 000 km^. 

Observations began in 2004 with a partial array and the gradual deployment of the designed 
Observatory was completed In April 2008 with 1 600 surface detectors and 24 fluorescence 
telescopes. After additional enhancements to extend the energy coverage to ~ 10^^ eV, more 
than 1 660 water-Cherenkov stations and 27 fluorescence telescopes are installed. The Pierre 
Auger Collaboration is a community of more than 500 members from 19 countries. 

Besides its huge aperture (volume of atmosphere and solid angle available for shower 
detection), the uniqueness of the Pierre Auger Observatory lies in the simultaneous observation 
of cosmic ray showers with two complementary techniques. Reconstructions combining surface 
and fluorescence data provide an opportunity to calibrate the surface detector (SD) signal using 
a shower energy which is measured very precisely by the fluorescence detector (FD). Moreover, 
In the, so-called, hybrid mode, timing information about the shower arrival on the ground from 
at least one SD station is used as additional information reconstructing the shower longitudinal 
prohle with the FD. The FD provides a very precise measurement of the properties of the shower 
electromagnetic component, which contains ~90% of its energy. 

The processes of managing and reconstructing the shower properties from the measured data 
are described in the following section. The third section includes specification of the Monte Carlo 
simulations of UHFCR showers. Selected results obtained using the measured and simulated 


data of the Pierre Auger Observatory are mentioned in Section 4. The conclusions are presented 
in Section 5. 



Figure 1: The view of the Pierre Auger Observatory deployment. Array of gray points represents 
positions of surface detector stations. The names of 4 fluorescence detector buildings are shown 
in blue together with illustrated azimuthal field of views of the individual fluorescence telescopes. 
Positions of atmospheric monitoring stations are marked in red. Locations of additional radio 
detection stations (AERA) and FD enhancement (HEAT) are also shown together with the 
position of the Central Campus. 



Figure 2: Schematic description of one water-Cherenkov station [T] (left panel) and one 
fluorescence telescope [3] (right panel). 

































































































2. Measured Data 

Each water-Cherenkov station samples signals from three photomultipliers (PMTs) with a 
frequency of 40 MHz. The signal is induced by both electromagnetic particles and muons. 
The time stamp is obtained from GPS. When one of the local trigger conditions on the PMT 
signals is fulfilled, the signal traces of three PMTs are sent via the communication antenna to the 
communication towers placed near the fluorescence detector buildings and finally to the central 
data acquisition system (CDAS), when further physics triggers are tested. Altogether, the SD 
raw data has to pass a five-level hierarchical trigger system [2] to be stored in data centers. 
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Figure 3: Schematic description of readout data flow at one fluorescence detector site. Picture 
comes from [3]. 


Each ED telescope collects fluorescence light in a camera consisting of 440 PMTs that are 
installed in the focal plane of the telescope. Signal traces from PMTs along a candidate shower 
track are also sent to the CDAS as illustrated in Fig. [3l ED raw data has to satisfy a three-level 
hierarchical trigger system [3] to be stored in data centers. The ED measurement is accompanied 
by regular monitoring of the atmosphere [ 5 . 

The SD and ED raw data from CDAS are copied to two facilities, in Lyon and Fermilab, via 
high speed Internet data-link. The overall size of SD and ED recorded raw data is a few TB 
per year. One typical shower has size ^hundreds of kB. 

The raw data in .root format are reconstructed using independent software coded in C++: 
Offline [5] for SD and ED and Herald for SD. The Offline software is a powerful tool for 
the simultaneous reconstruction of SD and ED data. It has access to CDAS data and to 
many formats of simulated showers as well as to databases of calibration constants, atmospheric 
conditions etc. It has a modular structure that allows a simple implementation of additional 
reconstruction algorithms or detector enhancements. For the practical purpose of faster and 
simpler physics analyses, the package Advanced Data Summary Tree (ADST) [7] was developed 
to store all the relevant information including the shower properties reconstructed using the 
Offline. A typical ADST shower reconstructed in SD and ED has a size of ~10 kB. The ADST 
data are stored in Karlsruhe on an ftp server with the overall size ~70 GB per one production 
of all types of data to mid-2014. 

























































































3. Simulated Data 

The simulation of detector signals proceeds in two steps. First, showers of typically 10^^ particles 
for UHECR energies are simulated with the 3D simulation program CORSIKA [8]. It uses 
different models of hadronic interactions for high (Eiab above 80 GeV) and low energy {Eiab below 
80 GeV) intervals. A so-called thin sampling (thinning) [9] is applied to save computational 
power. It assigns a higher weight to a randomly selected particle from a sample of secondary 
particles with total energy higher than an adjustable fraction of the primary energy, while all 
other secondaries are discarded. The typically used thinning level is 10“®. A typical shower 
generated at energy 10^*^ eV utilizes approximately 20 hours of GPU time of 1 core on a current 
processor even with the speed gained from thinning. In the second step, the simulations of 
detector responses of CORSIKA showers are performed using corresponding modules in the 
Offline. The required CPU time is smaller for lower energies but rises steeply and reaches values 
comparable to the CORSIKA part for energies 10^^ eV. 

Because there are several models to compare and many parameters to tune, we need a 
signihcant computing and storage capacity for these simulations. Local clusters available to 
some members of the collaboration were used. Each cluster might have different local setup 
and operating environment; validation of results was difficult. The unification came with the 
computing grid solution inspired by LHC experiments. The Prague group created a grid Virtual 
Organization (VO) auger in 2006 and started to run a common production of libraries of 
simulated showers using a custom production system based on shell scripts [TO]. Later the 
group from the University of Granada took the responsibility for the official production and 
developed a second version of the production system with MySQL database back-end m- The 
VO auger became one of the biggest users of the EGI grid resources after the LHC VOs [T2|. 
The success of grid usage was possible thanks to a similar workflow to high energy physics 
and thanks to resources from many centers where collaboration members were connected to. A 
signihcant fraction of CPU time was also provided by non-pledged resources. The stored output 
of simulated showers on the GRID is currently almost 500 TB in 36 million hies. 

The success in getting distributed resources brought problems with their management. It 
was shown that pilot jobs lead to better efficiency and higher usage. Also basic tools provided 
by the grid middleware for data management are not sufficient for large collections of the size 
of the VO auger data. The DIRAC interware m was tested hrst as a replacement for the hie 
catalog and later also for the production system. We plan to do a complete migration in 2015. 

4. Physics with Measured and Simulated Data 

Following features of UHECR showers were observed with the Pierre Auger Observatory data 
and their comparison with MC predictions so far: 

• Spectrum: The so called ankle at energy 10^®'^ eV and steep suppression beyond 10^®'® eV 
are observed with high statistical signihcance |14j . 

• Mass Composition: A light composition occurs at energies up to the ankle. A transition 
towards heavier nuclei with increasing energy seems to be present at energies beyond the 
ankle m- 

• p—p cross-section at 57 TeV: The total p-p cross-section was inferred US). Its value 
lies approximately in the range that is adopted by the models of hadronic interactions. 

• Muon Excess: The muon excess in measured data indicates a lack of understanding for 
all models of hadronic interactions [IZIII81II9|. 

• Photons and Neutrinos Searches: No observation of a photon or neutrino shower has 
been identihed yet. Limits on fluxes of photons exclude Top-down models |2n| . 

• Anisotropy: There is no excess of neutrons from the Galactic plane at EeV energies |21| . 
The only anisotropy at the highest energies (above ~55 EeV) that is stable in time is 


observed in the 20° vicinity of the closest AGN: Cen A |22j . The level of correlation with 
known nearby AGNs from the VGV catalog decreased with time [22] and does not increase 
with energy |23j . 

An upgrade of the Pierre Auger Observatory with muon detectors is planned to be built 
in the future. Reliable determination of the mass composition, especially at the highest 
energies, with large enough statistics seems to be the crucial point in further studies of UHEGR 
open questions (origins of the spectrum features, UHEGR sources, lack of muons in MG 
simulations). Measurement of the muon component with a large surface array (full duty cycle) 
could be one way to answer these questions. However, the observed inconsistency of model 
predictions and measured data for the muon component is an issue that needs to be fixed 
simultaneously. Accompanying measurements with more types of muon detectors combined 
with the measurement of the electromagnetic component could be not only beneficial, but also 
necessary. 

5. Conclusions 

Processing of measured as well as simulated data at the Pierre Auger Observatory is well 
established. Important findings about cosmic rays of ultra-high energy and hadronic interactions 
at energies beyond accelerator capabilities came from the unprecedentedly large statistics 
collected by the observatory during ten years of operation. An upgrade of the observatory 
with muon detectors could bring more light into the presented results. The modular structure 
of the Offline software provides an easy implementation of such further detector enhancements. 
The difficulties to perform large productions of MG libraries of cosmic-ray showers for the Pierre 
Auger Observatory on local computer centers has led to the unprecedented usage of the GRID 
infrastructures in the field of astroparticle physics. 
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